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Abstract 

Consensus strategies find a variety of applications in distributed coordination and decision making 
in multi-agent systems. In particular, average consensus plays a key role in a number of applications 
and is closely associated with two classes of digraphs, weight-balanced (for continuous-time systems) 
and bistochastic (for discrete-time systems). A weighted digraph is called balanced if, for each node 
Vj, the sum of the weights of the edges outgoing from that node is equal to the sum of the weights of 
the edges incoming to that node. In addition, a weight-balanced digraph is bistochastic if all weights 
are nonnegative and, for each node vj, the sum of weights of edges incoming to that node and the sum 
of the weights of edges out-going from that node is unity; this imphes that the corresponding weight 
matrix is column and row stochastic (i.e., doubly stochastic). We propose two distributed algorithms: 
one solves the weight-balance problem and the other solves the bistochastic matrix formation problem 
for a distributed system whose components (nodes) can exchange information via interconnection links 
(edges) that form an arbitrary, possibly directed, strongly connected coimnunication topology (digraph). 
Both distributed algorithms achieve their goals asymptotically and operate iteratively by having each 
node adapt the (normegative) weights on its outgoing edges based on the weights of its incoming 
links (i.e., based on purely local information). We also provide examples to illustrate the operation, 
performance, and potential advantages of the proposed algorithms. 

I. Introduction 

A distributed system or network consists of a set of subsystems (nodes) that can share 
information via connection links (edges), forming a directed communication topology (digraph). 

Themistoklis Charalambous is with the School of Electrical Engineering, Royal Institute of Technology (KTH), Stockholm, 

Sweden. E-mail: themisc@kth.se. 

Christoforos N. Hadjicostis is with the Department of Electrical and Computer Engineering at the University of Cjfprus, 
Nicosia, Cyprus. E-mail: chad jic@ucy . ac . cy. 



The successful operation of a distributed system depends on the structure of the digraph which 
typically proves to be of vital importance for our ability to apply distributed strategies and 
perform various tasks. Cooperative distributed control algorithms and protocols have received 
tremendous attention during the last decade by several diverse research communities (e.g., biol- 
ogy, physics, control, communication, and computer science), resulting in many recent advances 
in consensus-based approaches (see, for example, [|T|-[[8| and references therein). 

In general, the objective of a consensus problem is to have the agents belonging to a group 
agree upon a certain (a priori unknown) quantity of interest. When the agents reach agreement, 
we say that the distributed system reaches consensus. Such tasks include network coordination 
problems involving self-organization, formation patterns, parallel processing and distributed 
optimization. One of the most well known consensus problems is the so-called average consensus 
problem in which agents aim to reach the average of their initial values. The initial value 
associated with each agent might be, for instance, a sensor measurement of some signal [9], 
Bayesian belief of a decision to be taken pO|, or the capacity of distributed energy resources for 



the provisioning of ancillary services [ 11 1. Average consensus is closely related to two classes of 
graphs: weight-balanced (for continuous-time systems) and bistochastic graphs (for discrete-time 
systems). A weighted graph is balanced if for each node, the sum of the weights of the edges 
outgoing from that node is equal to the sum of weights of the edges incoming to that node. A 
bistochastic graph is a weight-balanced graph for which the weights are nonnegative and the 
sum of the weights for both outgoing and incoming edges (including self weights at each node) 
is equal to one. In both cases, all edge weights are typically required to be nonzero. 

It is shown in [2] that average consensus is achieved if the information exchange topology is 



both strongly connected and balanced, while gossip algorithms [ 12 1, [ 13 1 and convex optimization 



1 14 1 admit update matrices which need to be doubly stochastic. These methods have applicability 
to a variety of topics, such as multi-agent systems, cooperative control, and modeling the 
behaviour of various phenomena in biology and physics, such as flocking. Since their operation 
requires weight-balanced and bistochastic digraphs, it is important to be able to distributively 
transform a weighted digraph to a weight-balanced or bistochastic one, provided that each node 
is allowed to adjust the weight of its outgoing links accordingly. 

In this paper, we address the problem of designing discrete-time coordination algorithms 
that allow a networked system to distributively obtain a set of weights that make it weight- 



balanced or bistochastic. This task is relatively straightforward when the underlying communi- 
cation topology forms an undirected graph (i.e., when communication links are bi-directional) 
but more challenging when dealing with a digraph (i.e., when some communication links might 
be uni-directional). The paper proposes two algorithms that can be used in distributed networks 
with directed interconnection topologies; the first algorithm leads to a weight-balanced digraph. 
Even though there exist some earlier approaches in the literature for weight balancing (e.g., |15| 
presents a finite-time algorithm but does not characterize the number of steps required in the worst 



case, whereas |16| presents an asymptotic algorithm whose rate is bounded explicitly based on 
the structure of the graph), this is the first time, to the best of our knowledge, that an asymptotic 
algorithm of this nature is shown to admit geometric convergence rate. Work in the literature 
appears for bistochastic matrix formation as well (e.g., [ jl7| proposes an asymptotic algorithm 
with an unspecified rate of convergence). Our second proposed algorithm, a modification of the 
weight-balancing algorithm, leads to a bistochastic digraph with asymptotic convergence. Under 
some minor assumptions, this second algorithm can also be shown to admit a geometric rate. 
The remainder of the paper is organised as follows. In Section [11} we provide necessary notation 



and background on graph properties. In Section III, the problem to be solved is formulated, 
and Sections IV and |V] present our main results in which we propose two algorithms, one for 
weight-balancing and one for bistochastic matrix formation. Then, in Section |VI} the derived 
algorithms are demonstrated via illustrative examples and their performance is compared against 



existing approaches in the hterature. Finally, Section VII presents concluding remarks and future 
directions. 



II. Notation and Preliminaries 

The sets of real, integer and natural numbers are denoted by R, Z and IN, respectively; their 
positive orthant is denoted by the subscript + (e.g. IR+). The symbol INq denotes the set of non- 
negative integers. Vectors are denoted by small letters whereas matrices are denoted by capital 
letters; A^^ denotes the inverse of matrix A. By I we denote the identity matrix (of appropriate 
dimensions), whereas by 1 we denote a column vector (of appropriate dimension) whose elements 
are all equal to one. A matrix whose elements are nonnegative, called nonnegative matrix, is 
denoted hy A > and a matrix whose elements are positive, called positive matrix, is denoted 
by A > 0. (J (A) denotes the spectrum of matrix A, \{A) denotes an element of the spectrum of 



matrix A, and p{A) denotes its spectral radius. Notation diag(a:j) is used to denote the matrix 
with elements in the finite set {xi,X2, ...} on the leading diagonal and zeros elsewhere. 

Let the exchange of information between nodes be modeled by a weighted digraph (directed 
graph) Q{V,£, W) of order n {n > 2), where V = {fi,f2, • • • 5^n} is the set of nodes, £ C 
V X V - {{vj.Vj) I Vj e V} is the set of edges, and W = [wji[ e R"^" is a weighted nxn 
adjacency matrix where Wji are nonnegative elements. A directed edge from node Vi to node Vj 
is denoted by Sji — {vj,Vi) e E, which represents a directed information exchange link from 
node Vi to node vj, i.e., it denotes that node vj can receive information from node Vi. Note 
that the definition of Q excludes self-edges (though self-weights are added when we consider 
bistochastic digraphs). A directed edge sji G £ if and only if Wji > 0. The graph is undirected if 
and only if Sji e £ implies £y e £. Note that a digraph Q{V,£) can be thought of as a weighted 
digraph Q{V, £, W) by defining the weighted adjacency matrix W with wji = 1 if eji e £, and 
Wji — otherwise. 

A digraph is called strongly connected if for each pair of vertices Vj,Vi e V, Vj ^ Vi, 
there exists a directed path from Vj to Vi, i.e., we can find a sequence of vertices vj = vi^, 
vi^, vi^ = Vi such that (vi^^-^.vi^) E £ for r = 0, l,...,t — 1. All nodes that can transmit 
information to node Vj directly are said to be in-neighbors of node Vj and belong to the set 
— {vi E V \ Eji E £}. The cardinaUty of jV^~, is called the in-degree of j and it is denoted 
by Vj. The nodes that receive information from node j comprise its out-neighbors and are 
denoted by Mj' — {vi eV \ Sij E £}. The cardinality of M^, is called the out-degree of Vj and 
it is denoted by . Given a weighted digraph Q{V,£,W) of order n, the total in-weight of 
node Vj is denoted as Sj and is defined by Sj = Yliv^&j\r~ whereas the total out-weight of 
node Vj is denoted by S'j' and is defined as = J^vieAf:^ ^'i- 

Definition 1: A weighted digraph Q{V, £, W) is called weight-balanced if the total in-weight 
equals the total out-weight for every node Vj e V, i.e., S~ — Sj'. A weight-balanced digraph 
is also called doubly stochastic (bistochastic) if each of its weighted adjacency matrix rows and 
columns sums to 1. 

For the discrete-time setup we investigate, we conveniently define the time coordinate so that 
unity is the time between consecutive iterations. For example Sj~[k] will denote the value of the 
out-weight of node Vj at time instant /c. A; e INq. 



III. Problem Formulation 

Given a digraph Q{V,£), we want distributed algorithms that allow the nodes to obtain a 
weight matrix W = [wji such that the following are achieved. 

(i) The weighted digraph becomes balanced in a distributed fashion; i.e., a weight matrix 
W is found such that wji > for each edge {vj,Vi) E E, wji = if {vj,Vi) ^ E, and 
Sj^ = Sj' for every vj G V. 

(ii) The weighted digraph becomes bistochastic in a distributed fashion; i.e., a weight matrix 
W is found with nonnegative diagonal elements wjj > 0, such that wji > if (f j, fi) G E, 



w 



if {vj, Vi) ^ E, Vj 7^ Vi), and wjj + Sj' = Wjj + Sj =1 for every vj G V. 



IV. Distributed algorithm for weight-balancing 

A. Description of the algorithm 

Balancing a weighted digraph can be accomplished via a variety of algorithms. We introduce 
and analyse a distributed cooperative algorithm that exhibits asymptotic convergence and outper- 



forms existing algorithms suggested in the literature [ 18 1. The algorithm achieves weight-balance 



as long as the underlying digraph is strongly connected (or is a collection of strongly connected 



digraphs, a necessary and sufficient condition for balancing to be possible [19|). The rate of 
convergence of the algorithm is geometric and depends exclusively on the structure of the given 
diagraph and some constant parameters chosen by the nodes. 

Algorithm 1 is an iterative algorithm in which the nodes distributively adjust the weights of 
their outgoing links such that the digraph becomes asymptotically weight-balanced. We assume 
that each node observes but cannot set the weights of its incoming links. Given a strongly 
connected digraph Q{V,£), the distributed algorithm has each node initialize the weights of all 
of its outgoing links to unity, i.e., wij[0] = 1, Vf; G Af^. Then, it enters an iterative stage where 
each node performs the following steps: 

1) It computes its weight imbalance defined by 

xAk] = Sj[k]-Sl[k]. (1) 

2) If it is positive (resp. negative), all the weights of its outgoing links are increased (resp. 
decreased) by an equal amount and proportionally to Xj[k]. 



We discuss why the above distributed algorithm asymptotically leads to weights that balance the 
graph (and also characterize its rate of convergence) after we describe the algorithm in more 
detail. For simplicity, we assume that during the execution of the distributed algorithm, the nodes 
update the weights on their outgoing links in a synchronou^ fashion. Also note that 2) above 
implies that wij for vi E will always have the same value. 

Algorithm 1 Weight balancing algorithm 

Input: A strongly connected digraph Q(y,8) with n = \V\ nodes and m = \S\ edges (and no 
self- loops). 

Initialization: Each node vj G V 

1) Sets wij[0] = l,yvi G A/"/. 

2) Chooses G (0,1). 

Iteration: For k = 0,1,2,..., each node vj G V updates the weights of each of its outgoing 
hnks wij, Vfi G Afj', as 

fs-[k] \ 

wi, [k + l]= wi, [k] + /3, ^ - wi, [k] . (2) 



The intuition behind the proposed algorithm is that we compare Sj [k] with Sj' [k] = D^Wij [k] . 
If S'^lk] > Sj[k] (resp. S^[k] < Sj'lk]), then the algorithm reduces (resp. increases) the weights 
on the outgoing links. 

Proposition 1: If a digraph is strongly connected or is a collection of strongly connected 
digraphs. Algorithm [7] reaches a steady state weight matrix W* that forms a weight-balanced 
digraph, with geometric convergence rate equal to 

where 

6{P) = max{|A| : A G cx{P)), A ^ 1}. 

Proof: First, we observe from equation ([2]) that all the outgoing links have the same weight, 
i.e., wi'j = wij, \/vi/,vi G Af^ (because they are equal at initialization and they are updated in the 



'Even though we do not discuss this issue in the paper, asynchronous operation is not a problem. 



same fashion). Hence, from hereafter, we will denote the weight on any outgoing link of node 
Vj as Wj. In order to study the system with update formula (|2]) for each node in the graph, we 
define w = {wi W2 ... Wn)^ with wj = wij {vi G ■Sfj'), and thus we can write the evolution 
of the weights in matrix form as follows. 

w[k + 1] = Pw[k], w[Q] = Wo (3) 

where Wq = 1 and 

P,4'-'" (4) 

It should be clear from the above update equation that the weights remain nonnegative during 
the execution of the algorithm. 

Matrix P can be written as P = I — B + BD^^A, where / is the identity matrix, B = diag(/3j), 
D = diag(D^) and A is the adjacency matrix with aji = 1 if £ji E £, and aji = otherwise. 
Since a{D-^A) = (r{AD-^), then p{D-^A) = p{AD-^). In addition, piAD'^) = 1 because 
matrix AD^^ is column stochastic. As a result, p(D^^A) = 1. Also, note that P = I — B + 
AD^^B is column stochastic and therefore p(P) = 1. Furthermore, 

p(P) = p{PB-^DD-^B) = p{D-^BPB-^D) 
= p{D-^B{I -B + AD-^B)B-^D) 
= p{I-B + BD-^A) = p{P) = 1. 

Since P is a nonnegative matrix, we can ask whether P is primitivej^ i.e., whether P™ > 
for some m > 1. Since the digraph is strongly connected for < /3j < 1, Vf^ G V and all the 
main diagonal entries are positive, we easily conclude that m < n — 1 ||20} Lemma 8.5.5] and 
P is primitive. Hence, there is no other eigenvalue with modulus equal to the spectral radius. 
A sufficient condition for primitivity is that a nonnegative irreducible matrix A has at least one 



positive diagonal element [21 Example 8.3.3], which means that some /3j can also be set at 
unity (as long as at least one is strictly smaller than unity). Hence, iteration (|3]) has a geometric 
convergence rate Poo(-P) = — ln5(P), where 5{P) = max{|A| : A G a(P)),\ ^ 1}. In other 



nonnegative matrix is said to be primitive if it is irreducible and has only one eigenvalue of maximum modulus 



20 



words, 5{P) is the second largest of the moduli of the eigenvalues of P (see also [[T|, [|2|, Q). 

■ 

Remark 1: If we change the coordinates of w[k] by introducing z[k] = B^^Dw[k:], then 
equation ([3]) becomes z[A; + l] = B^^DPD^^Bz[k] = Pz[k], which has total mass (1^2;[A;]) that 
remains invariant throughout the iteration (and equal to 1^2;[0] = l^fi^^Dl). 

B. Illustrative Example 

In this illustrative example (borrowed from p9|), we demonstrate the validity of the proposed 
algorithm in the network depicted in Figure [T| In our plots we are typically concerned with the 
absolute balance defined as e\k] = X]j=i where Xj[k] is given in ([T]). If weight balance 

is achieved, then e[k:] = and Xj[k] = 0, Vfj G V. 




Fig. 1. A simple digraph which is weight-balanceable, but not bistochasticable due to the absence of self-loops. This example 
is given in [19] in order to indicate that not all strongly connected digraphs are bistochasticable. 

Figure |2] shows the absolute balance of Algorithm 1 when /3j = 0.1, 0.5 and 0.9 for all Vj E V 
as it evolves during the execution of the algorithm. These plots agree with the claims in Proposi- 
ion [T] and validate that the algorithm convergences to a weight-balanced digraph with geometric 
convergence rate. In this particular example, with the choice of (3j = 0.1,0.5 and 0.9, the rate 
discussed in the proof of Proposition [T] is given by Roo{P{(3j)) = 0.1204,0.5180 and 0.2524, 
respectively. The rates of convergence are also illustrated in Figure [3j where the convergence 
rate of Algorithm 1 as obtained in Proposition [T] and the actual convergence rate of the algorithm 
characterized by matrix (|4]). The theoretical and actual convergence rates coincide. 




Number of iterations 

Fig. 2. Absolute balance for weight-balancing algorithm (Algorithm 1) for the digraph depicted in Figure [T] 



Rate of convergence of Algoritlinn 1 for different values of (3. 




Number of iterations 

Fig. 3. Comparison of the theoretical rate of convergence as obtained in Proposition [T| and the actual convergence rate of the 
weight-balancing algorithm {Algorithm 1) for the digraph depicted in Figure [T| for /3j = 0.1,0.5 and 0.9. The dashed lines 
show the theoretical convergence rate, while the solid lines show the actual convergence rate of the algorithm. 



The final weight-balanced digraph W* is the same for all three cases mentioned above (because 



all the /3j are identical 



— but equal to a different constant each time) and is given by 



0.7143 0.7143 

1.4286 

1.4286 
0.7143 

Remark 2: If (3j = 1, Vf-, G V, then the weighted adjacency matrix P is not necessarily 
primitive and hence the algorithm does not converge to weights that form a weight-balanced 
digraph. We can see this in the counterexample depicted in Figure |4} We run Algorithm 1 for 




Fig. 4. A simple digraph which is weight-balanceable, but the adjacency matrix is not primitive. 



three different cases: (a) = 1, ^Vj G V, (b) /Sj = 0.9, Vw^ G V and (c) /3i = 0.9 and = 1, 
Vfj G V — {vi}. It can be seen from Figure [5] that for the first case the matrix is not primitive 
and it does not converge, whereas for the other two cases it asymptotically converges (because 
as long as one of the nodes has (3j < 1, then the update matrix is primitive and the algorithm 
forms a weight-balanced digraph). 

V. Distributed algorithm for bistochastic matrix formation 

A. Description of the algorithm 

An algorithm is proposed, herein called Algorithm 2, with which a bistochastic adjacency 
matrix is formed in a distributed fashion. One extra requirement for Algorithm 2, however, is 
to maintain column stochasticity of the weighted adjacency matrix W[k] for all times k, so 



Weight-balancing problem - counterexample 








Algorithm 1 for p.=0.9 for all v. 
Algorithm 1 for (3^=0.9 and p.=1 for all v.^ v. 
Algorithm 1 for p.=1 for all v. 
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Fig. 5. A simple digraphi wiiich is weight-balanceable, but when /3j — 1, Vu_, G V, the weighted adjacency matrix is not 
primitive and hence the algorithm does not converge to weights that form a weight-balanced digraph. 

that it can be used for consensus problems simultaneously from the beginning without the need 
to form the bistochastic matrix before running an algorithm. More specifically, we obtain a 
sequence of column stochastic matrices iy[0], [2], . . . , W[k] such that limfc_>.oo W[k] = 

W is bistochastic and thus the iteration x[k + 1] = Vr[/i;]x[A; + 1], x[0] = xq, reaches average 
consensus asymptotically pj| . 

Digraphs that are weight-balanceable do not necessarily admit a doubly stochastic assignment 
p9l Theorem 4.1]. However, if self- weights are added then any strongly connected graph is 
bistochasticable after adding enough self-loops [[19} Corollary 4.2]. Algorithm 2 overcomes this 
problem with the introduction of nonzero self weights wjj at each node Vj E V, and their 
appropriate adjustment in a distributed manner. Algorithm 2 is described in detail below. 

Proposition 2: If a digraph is strongly connected or is a collection of strongly connected 
digraphs, then Algorithm |2] reaches a steady state weight matrix W* that forms a bistochastic 
digraph. Furthermore, the weights of all edges in the graph are nonzero. 

Proof: As before, all the outgoing links have the same weight, i.e., wi'j = wij, yvi>i,vi G 
J\fj^. Thus, the evolution of the weight Wj = wij, Vf; G Mj', can be written in matrix form as 



follows. 



w[k + l] = P[k]w[k],w[0] = wq 



(8) 



Algorithm 2 Bistochastic matrix formation algorithm 



Input: A strongly connected digraph Q{V,S) with n — \V\ nodes and \E\ edges (and no self- 
loops). 

Initialization: Set wij[0] = 1/(1 + V+), V-u, e jV/ U {j}. 

Iterations: For k = 0,1,2,..., each node vj e V updates the weights wij, vi e Af^', by 
performing the following steps: 
1) It chooses Pj[k] as follows: 

aj, otherwise, 



where aj e (0, 1). 
2) It updates 



wij[k + 1] = wij[k] + m I %P - ^lAk] I , (6) 



for all vi e jVj^. [This is the same update as Algorithm 1, with the difference that the 
proportionality constant /3j can be adapted at each time step k, and is chosen so that 
Sj'[k + 1] < 1 (so as to ensure that wjj can be chosen in Step 3 to be nonnegative and satisfy 

Wjj + S+[k + l] = 1).] 

3) Then, lUjj > is assigned so that the weighted adjacency matrix retains its column 
stochasticity; i.e.. 



[A; + 1] = 1 - J2 ^iAk + 1], V^;,- e V. (7) 



where 

PAk] = { ' (9) 

[m/Dt if^eA/;- 

In order to make sure that the sum of each column can be made one by choosing a nonnegative 
self-weight wjj, we need to establish (for all k) that Sj'[k + 1] < 1 or wij[k + 1] < 1/-^^, for 
all vi e H^. In our updates, there are two cases: (a) Sj[k] < S^[k], and (b) Sj[k] > S'^[k]; 



we analyze both cases below. 

(a) When Sj[k] < S^[k], then j3j[k] can be chosen to be any value aj, aj G (0, 1). Then, the 
algorithm is equivalent to Algorithm 1 and admits geometric convergence rates. 

(b) When Sj'lk] > Sj'lk], then wij[k + 1], Vf; G A/^^, are increased. In order to avoid having 
S^[k + 1] > 1 or wij[k + 1] > 1/-^/ for ^^Y ^ we choose j3j[k] as shown in equation 

In this case, for any initial Sj'lO] for which Sj[k] > Sj'lk], from ([6]) we obtain that 

Silk + l] = Sl[k]+a,{l- Silk]) 

Hence, it is guaranteed that Sj'lk + 1] < 1, and as a result, (3j[k] ^ for all k. It can be easily 
shown by perfect induction that after n steps (for which Sj[k + r] > Sj'lk + r] holds for all 
r G r < n) we have 

Sl[k + n] = l-il-a,ni-Sl[k]), 

that approaches 1 as n — )■ oo. Note that someone can choose aj G (0, 1) closer to 1 and guarantee 
that l3j [k] > e, e > 0, for all the iterations k. 

m 

Unlike the case of Algorithm 1, in Algorithm 2 we have a discrete-time switching dynam- 
ical system whose stability condition and convergence rate are not as easily characterized. As 
indicated by the various simulations we have tried (as well as the special case identified by 
the remark below), it is very likely that the rate of convergence of Algorithm 2 is geometric, 
however, this has not been formally established thus far. 

Proposition 3: If a digraph is strongly connected or is a collection of strongly connected 
digraphs, then Algorithm^v/ith initial condition wliIO] = +, , Vf^ G A/"/", m > \V\, reaches 
a steady state weight matrix W* that forms a bistochastic digraph, with geometric convergence 
rate equal to Roo{P) = — ln5(P), where 



l-aj if i = j, 
aj/D+ if ie^r. 
Furthermore, the weights of all edges in the graph are nonzero. 



Proof: If it is possible for each node to know the number of nodes in the graph, or at least 
an upper bound, then we can set ^^^^[0] = , _|; +, for all G , where m > \V\. Hence, 
we establish that ^^"[O] < 1 and Sj'lO] < 1 for all vj E V. By equation ^ we have that 

sl[k + i] = {i-m)sm + (^Ak]sj[k] 

which guarantees that S^[k] < 1 and that (3j[k] = aj, for all k. The self-weights are chosen so 
that we make each column sum up to one (and consequently the row sums, once the algorithm 
converges). Therefore, with these initial conditions we can choose (3j[k] to be constant (and 
equal to aj E (0, 1)) throughout the execution of the algorithm, and hence, admit geometric 
convergence rate (because we are essentially back to Algorithm 1 with the only difference that 
we also calculate the value of the self- weight (equal to 1 — Vj'Wjlk]) each time). Therefore, 
Algorithm 2 has a geometric convergence rate i?oo(-P) = — ln(5(P), as in Algorithm 1. ■ 
Remark 3: As before, if we change the coordinates of w[k] by introducing z[k] = B^^Dw[k], 
then equation ([8]) becomes z[k + 1] = B^^ D P[k]B D^^ z[k] = P[k:]z[k], which has total mass 
(1-^2 [A;]) that remains invariant. 

B. Illustrative Example 

We consider a random strongly connected graph consisting of 50 nodes. The quantity of 
interest in this case is the absolute balance of the graph at time step k; the absolute balance 
Ab[k] is defined as 

Ab[k] = E 1 - E ^^-^t^] • 

Since the weight matrix at each time step is column stochastic by construction, Ab[k] effectively 
measures the distance of the weight matrix at time step k from a bistochastic matrix. As it can 
be seen from Figure |6} the algorithm asymptotically converges to a bistochastic adjacency matrix 
for different values of aj (in the simulations aj is chosen to be 0.9,0.5 and 0.1). 

VL Comparisons 
A. Weight-Balanced Matrix Formation 

Here we run the algorithm for larger graphs (of size n = 50) and we compare the performance 



of our algorithm against the imbalance-correcting algorithm in [ 15 1 in which every node vj adds 



all of its weight imbalance Xj to the outgoing node with the lowest weight w. 



Bistochastic matrix formation for a random graph of 50 nodes for various values of a. 




a.=0.9 for all v. 

■ J ) 

a.=0.5 for all v. 

■ J ) 

a.=0.1 for all V. 

J ) 
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Fig. 6. Absolute balance for bistochastic formation algorithm (Algorithm 2) for different values of Oj Vt;^ G V. It can be 
observed that Algorithm 2 converges to a bistochastic adjacency matrix asymptotically. 



The suggested weight-balancing algorithm (Algorithm 1) shows geometric convergence and 
outperforms the algorithm suggested in [15], as shown in Figure |7} 

B. Bistochastic Matrix Formation 

Here we run the algorithm for larger graphs (of size n = 50) and we compare the performance 



of our algorithm against a distributed algorithm suggested in [17| in which every node Vj G V 
first chooses a particular weight Wjj[k] E (0, 1) for its self weight and it sets the weights of its 
outgoing links to be wij[k] = Qj(1 - Wjj[k]), where cij > 0, \/vi e , and Y,vi(iM+ % = 1- 
The suggested bistochastic formation algorithm {Algorithm 2) shows asymptotic convergence 



and slightly outperforms the algorithm suggested in |17| for aj = 0.95, Wvj G V, as shown in 
Figure [8j 

VIL Conclusions and Future Directions 

In this paper we have developed two iterative algorithms: one for balancing a weighted 
digraph and one for forming a bistochastic adjacency matrix in a digraph. Both algorithms 
are distributed and the second one is a direct extension of the first one. The weight-balancing 
algorithm is asymptotic and is shown to admit geometric convergence rate. The second algorithm. 
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Fig. 7. Top figure: Absolute balance plotted against the number of iterations for a random graph of 50 nodes for the distributed 
weight-balancing (Algorithm 1) algorithm, the imbalance-correcting algorithm |15| , and the weight-balancing algorithm proposed 
in (16| . Bottom figure: Average balance plotted against the number of iterations for a 1000 random graphs of 50 nodes for the 
distributed weight-balancing {Algorithm 1), the imbalance-correcting algorithm (15| , and the weight-balancing algorithm proposed 
in |il6j. 



a modification of the weight-balancing algorithm, leads to a bistochastic digraph with asymptotic 
convergence admitting geometric convergence rate for a certain set of initial values. The two 
algorithms perform very well compared to existing algorithms, as illustrated in the examples. 

Future work includes the analysis of the behavior of the suggested algorithms in the presence 
of delays and changing topology. 
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Fig. 8. Top figure: Absolute balance for bistochastic formation algorithms (Algorithm 2) and a distributed algorithm suggested in 
|17| for a random strongly connected graph consisting of 50 nodes. Bottom figure: Average balance plotted against the number 
of iterations for a 100 random strongly connected graphs of 50 nodes for the distributed bistochastic formation algorithms 
(Algorithm 2) and a distributed algorithm suggested in (17) . 
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